Papers with open-source Lucene search library
Applying BERT to Document Retrieval with Birch (D19-3)
Copied to clipboard
| Challenge: | Birch is an open-source document retrieval system that integrates with the Anserini information retrieval toolkit to demonstrate end-to-end search over large document collections. |
| Approach: | They propose to integrate Anserini with a BERT-based document ranking model that provides an end-to-end open-source search engine. |
| Outcome: | The proposed system outperforms existing approaches to document retrieval and question answering on standard newswire and social media test collections. |
Operational Advice for Dense and Sparse Retrievers: HNSW, Flat, or Inverted Indexes? (2025.acl-industry)
Copied to clipboard
| Challenge: | Currently, practitioners working on dense retrieval face a bewildering number of choices. |
| Approach: | They propose a framework for thinking about retrieval in terms of nearest-neighbor search over vector representations where these representations can be dense (typically called embeddings, generated from transformers) or flat (with brute-force search) |
| Outcome: | The proposed model explicates tradeoffs between HNSW and flat indexes from the perspectives of indexing time, query evaluation performance, and retrieval quality. |